• Automatic Unsupervised Clustering of Videos of the Intracytoplasmic Sperm Injection (ICSI) Procedure 

      Storås, Andrea; Riegler, Michael Alexander; Haugen, Trine B.; Thambawita, Vajira L B; Hicks, Steven Alexander; Hammer, Hugo Lewi; Kakulavarapu, Radhika; Halvorsen, Pål; Stensen, Mette Haug (Chapter; Bokkapittel, 2023-02-02)
      The in vitro fertilization procedure called intracytoplasmic sperm injection can be used to help fertilize an egg by injecting a single sperm cell directly into the cytoplasm of the egg. In order to evaluate, refine and improve the method in the fertility clinic, the procedure is usually observed at the clinic. Alternatively, a video of the procedure can be examined and labeled in a time-consuming ...
    • CELLULAR, A Cell Autophagy Imaging Dataset 

      al Outa, Amani; Hicks, Steven; Thambawita, Vajira L B; Andresen, Siri; Enserink, Jorrit Martijn; Halvorsen, Pål; Riegler, Michael Alexander; Knævelsrud, Helene (Journal article; Tidsskriftartikkel; Peer reviewed, 2023-11-16)
      Cells in living organisms are dynamic compartments that continuously respond to changes in their environment to maintain physiological homeostasis. While basal autophagy exists in cells to aid in the regular turnover of intracellular material, autophagy is also a critical cellular response to stress, such as nutritional depletion. Conversely, the deregulation of autophagy is linked to several diseases, ...
    • A comprehensive analysis of classification methods in gastrointestinal endoscopy imaging 

      Jha, Debesh; Ali, Sharib; Hicks, Steven; Thambawita, Vajira L B; Borgli, Hanna; Smedsrud, Pia H.; de Lange, Thomas; Pogorelov, Konstantin; Wang, Xiaowei; Harzig, Philipp; Tran, Minh-Triet; Meng, Wenhua; Hoang, Trung-Hieu; Dias, Danielle; Ko, Tobey H.; Agrawal, Taruna; Ostroukhova, Olga; Khan, Zeshan; Tahir, Muhammed Atif; Liu, Yang; Chang, Yuan; Kirkerød, Mathias; Johansen, Dag; Lux, Mathias; Johansen, Håvard D.; Riegler, Michael; Halvorsen, Pål (Journal article; Tidsskriftartikkel; Peer reviewed, 2021-02-19)
      Gastrointestinal (GI) endoscopy has been an active field of research motivated by the large number of highly lethal GI cancers. Early GI cancer precursors are often missed during the endoscopic surveillance. The high missed rate of such abnormalities during endoscopy is thus a critical bottleneck. Lack of attentiveness due to tiring procedures, and requirement of training are few contributing factors. ...
    • GridHTM: Grid-Based Hierarchical Temporal Memory for Anomaly Detection in Videos 

      Monakhov, Vladimir; Thambawita, Vajira L B; Halvorsen, Pål; Riegler, Michael (Journal article; Tidsskriftartikkel; Peer reviewed, 2023-02-13)
      The interest in video anomaly detection systems that can detect different types of anomalies, such as violent behaviours in surveillance videos, has gained traction in recent years. The current approaches employ deep learning to perform anomaly detection in videos, but this approach has multiple problems. For example, deep learning in general has issues with noise, concept drift, explainability, ...
    • HTAD: A Home-Tasks Activities Dataset with Wrist-Accelerometer and Audio Features 

      Garcia-Ceja, Enrique; Thambawita, Vajira L B; Hicks, Steven; Jha, Debesh; Jakobsen, Petter; Hammer, Hugo Lewi; Halvorsen, Pål; Riegler, Michael (Journal article; Tidsskriftartikkel; Peer reviewed, 2021-01-21)
      In this paper, we present HTAD: A Home Tasks Activities Dataset. The dataset contains wrist-accelerometer and audio data from people performing at-home tasks such as sweeping, brushing teeth, washing hands, or watching TV. These activities represent a subset of activities that are needed to be able to live independently. Being able to detect activities with wearable devices in real-time is important ...
    • Kvasir-Capsule, a video capsule endoscopy dataset 

      Smedsrud, Pia H; Thambawita, Vajira L B; Hicks, Steven; Gjestang, Henrik; Olsen Nedrejord, Oda; Næss, Espen; Borgli, Hanna; Jha, Debesh; Berstad, Tor Jan; Eskeland, Sigrun Losada; Lux, Mathias; Espeland, Håvard; Petlund, Andreas; Dang Nguyen, Duc Tien; Garcia, Enrique; Johansen, Dag; Schmidt, Peter Thelin; Toth, Ervin; Hammer, Hugo Lewi; de Lange, Thomas; Riegler, Michael Alexander; Halvorsen, Pål (Journal article; Tidsskriftartikkel; Peer reviewed, 2021-05-27)
      Artificial intelligence (AI) is predicted to have profound effects on the future of video capsule endoscopy (VCE) technology. The potential lies in improving anomaly detection while reducing manual labour. Existing work demonstrates the promising benefits of AI-based computer-assisted diagnosis systems for VCE. They also show great potential for improvements to achieve even better results. Also, ...
    • Njord: a fishing trawler dataset 

      Nordmo, Tor-Arne Schmidt; Ovesen, Aril Bernhard; Juliussen, Bjørn Aslak; Hicks, Steven; Thambawita, Vajira L B; Johansen, Håvard D.; Halvorsen, Pål; Riegler, Michael Alexander; Johansen, Dag (Chapter; Bokkapittel, 2022-08-05)
      Fish is one of the main sources of food worldwide. The commercial fishing industry has a lot of different aspects to consider, ranging from sustainability to reporting. The complexity of the domain also attracts a lot of research from different fields like marine biology, fishery sciences, cybernetics, and computer science. In computer science, detection of fishing vessels via for example remote ...
    • On evaluation metrics for medical applications of artificial intelligence 

      Hicks, Steven A.; Strumke, Inga; Thambawita, Vajira L B; Hammou, Malek; Riegler, Michael Alexander; Halvorsen, Pål (Journal article; Tidsskriftartikkel; Peer reviewed, 2022-04-08)
      Clinicians and software developers need to understand how proposed machine learning (ML) models could improve patient care. No single metric captures all the desirable properties of a model, which is why several metrics are typically reported to summarize a model’s performance. Unfortunately, these measures are not easily understandable by many clinicians. Moreover, comparison of models across studies ...
    • Usefulness of Heat Map Explanations for Deep-Learning-Based Electrocardiogram Analysis 

      Storås, Andrea; Andersen, Ole Emil; Lockhart, Sam; Thielemann, Roman; Gnesin, Filip; Thambawita, Vajira L B; Hicks, Steven; Kanters, Jørgen K.; Strumke, Inga; Halvorsen, Pål; Riegler, Michael (Journal article; Tidsskriftartikkel; Peer reviewed, 2023-07-11)
      Deep neural networks are complex machine learning models that have shown promising results in analyzing high-dimensional data such as those collected from medical examinations. Such models have the potential to provide fast and accurate medical diagnoses. However, the high complexity makes deep neural networks and their predictions difficult to understand. Providing model explanations can be a way ...
    • Using 3D Convolutional Neural Networks for Real-time Detection of Soccer Events 

      Rongved, Olav Andre Nergård; Hicks, Steven; Thambawita, Vajira L B; Stensland, Håkon Kvale; Zouganeli, Evi; Johansen, Dag; Riegler, Michael Alexander; Halvorsen, Pål (Journal article; Tidsskriftartikkel; Peer reviewed, 2021-06)
      Developing systems for the automatic detection of events in video is a task which has gained attention in many areas including sports. More specifically, event detection for soccer videos has been studied widely in the literature. However, there are still a number of shortcomings in the state-of-the-art such as high latency, making it challenging to operate at the live edge. In this paper, we present ...